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Abstract 

In this paper we study the almost sure central limit theorem started from 
a point for additive functionals of a stationary and ergodic Markov chain via a 
martingale approximation in the almost sure sense. As a consequence we derive 
the quenched CLT for additive functionals or reversible Markov chains. 

1 Introduction 

In 1986 Kipnis and Varadhan proved the functional form of the central limit 
theorem for additive functionals of stationary reversible ergodic Markov chains 
under a minimal spectral assumption. This result was established with respect 
to the stationary probability law of the chain. In their remark (1.7) Kipnis and 
Varadhan raised the question if their result also holds with respect to the law 
of the Markov chain started from x, for almost all x. 

The central limit theorem for stationary Markov chains with normal operator 
holds under a similar spectral assumption as discovered by Gordin and Lifshitz 
(1981) (see also and Borodin and Ibragimov, 1994, ch 4 sections 7-8, Derriennic 
and Lin, 1996, Zhao and Woodroofe, 2008). 

The problem of quenched CLT for normal stationary and ergodic Markov 
chains was considered by Derriennic and Lin (2001 a and b) and Cuny (2009 a) 
under some reinforced assumptions. The results concerning reversible Markov 
chains are usually obtained as corollaries. Our Theorem [2l provides a central 
limit theorem started at a point for reversible Markov chains that improves the 
results known in the literature and answers a question raised by Derriennic and 



1 Supported in part by a Charles Phelps Taft Memorial Fund grant and NSA grant H98230- 
09-1-0005 

Key words: Quenched central limit theorem, reversible Markov chains. 
AMS 2000 Subject Classification: Primary 60F05, 60F15, 60J05. 



1 



Lin (2001 a, section 7). It is specific for reversible Markov chains and the result 
does not hold for normal Markov chains without further reinforcing the spectral 
condition (see Proposition 0] below). 

Examples of reversible Markov chains frequently appear in the study of in- 
finite systems of particles, random walks or processes in random media. In 
this context, the almost sure validity of the central limit theorem refers to as 
"quenched" media as opposed to the "annealed" media. A simple example of 
Normal Markov chain is a random walk on a compact group. 

Our method of proof follows the classical line of martingale approximation, 
stressing now the study of the almost sure asymptotic results for the rest. 

The paper is organized as following. In Section 2 we give the definitions, 
recall some needed results and formulate our result. Section 3 contains the proof 
of the theorem and also general results on the quenched CLT for stationary 
processes that have interest in themselves. Applications to random walks on 
compact groups are given in Section 4. A general maximal inequality is given 
in the Appendix. 

2 Definitions Background and Results 

2.1 Notations 

We assume that (£n)nez is a stationary and ergodic Markov chain de- 
fined on a probability space (f2, T ', P) with values in a measurable space (S, A). 
The marginal distribution is denoted by ir(A) = P(£o G A) and we sup- 
pose there is a regular conditional distribution for £i given £o denoted by 
Q(x,A) — P(£i G A\ £ = x). In addition Q denotes the operator acting via 
(Qf)(x) = f s f(s)Q(x,ds). Next let Lq(7t) be the set of functions on S such 
that J f 2 dn < oo and J fdn — 0. For a function / gLq(7t) let Xi = /(&), 

n 

S n = Xi. Denote by Th the tr-field generated by £j with i < k. For any 

i=l 

integrable variable X we denote Efc(X) = E(X\J 7 k)- In our notation Eo(-Xi) = 
(<3/)(Co) =EpTi|£ )- We denote by ||X|| 2 the norm in L 2 (f7,J r , P) and by ||/|| 2 
the norm in £12(71"). 

Denote by P^ and E^ the regular probability and conditional expectation 
given Xq = x. By the CLT started at a point (quenched) we understand that 
the CLT holds for tt— almost all x G S, under the measure P x . 

The Markov chain is called normal if QQ* = Q*Q on £2(71"), where the 
adjoint operator Q* is defined by < Qf, g >—< f,Q*g >, for every / and g in 
1.2(71"). For every / in L 2 (7r) we denote by pf the spectral measure of / with 
respect to Q on the unit disk D. 

The Markov chain is called reversible if, Q = Q*. For reversible Markov 
chains the spectral measure is concentrated on [—1,1]. 
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2.2 Background and Results 

The central limit theorem for normal Markov chains was announced by 
Gordin and Lifshitz, (1981) and also treated by Derriennic and Lin (1996). Its 
proof can be found in Borodin and Ibragimov (1994, ch. 4, sections 7). The 
result basically states that for every stationary ergodic Markov chain with Q 
normal and / gLq(7t) satisfying 

———pf{dz) < oo , (1) 
d I 1 - A 



then the central limit theorem holds for S ri j \fn. 

For reversible Markov chains, under the same spectral condition, Kipnis and 
Varadhan (1986) proved that the central limit theorem holds in its functional 
form. Let us introduce the notation [x] as being the integer part of x and for 
< t < 1 define 

W n (t) = %^ . 

W n (t) belongs to the space D[0, 1] of functions continuous from the right with 
limits from the left endowed with the uniform topology. 

Theorem 1 (Kipnis and Varadhan, 1986). Assume (£ n )nez is a stationary 
ergodic reversible Markov chain and / gLq(7t) satisfies 

1 1 

i — t Pf{dt) < oo . (2) 
Then, W n (t) converges weakly to \<jf\W, where 

and W(t) denotes the standard Brownian motion on [0, 1]. 

Spectral condition {2} (see Kipnis and Varadhan, 1986) is equivalent to 

lim ^1 = a) . (3) 

n— >oo n 

An important problem is to investigate the validity of the almost sure central 
limit theorem started at a point for additive functionals of stationary ergodic 
normal Markov chains or reversible Markov chains under condition |T]). For 
normal Markov chains Derriennic and Lin (2001, p. 515) pointed out that in 
general condition (fT]) does not assure the validity of the CLT started at a point. 
In the context of normal stationary and ergodic Markov chains the problem of 
quenched CLT was considered by Derriennic and Lin (1996, 2001 a) and Cuny 
(2009) under some reinforced assumptions. 

For reversible Markov chains, we shall improve their results. 
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Theorem 2 Assume (£j)ieZ *s a stationary and ergodic reversible Markov chain 
and f <E L§(7r) satisfies 

1 (log + |log(l-t)|) 2 

pf{dt) < oo . (4) 

l 1 — t 

Then, there is a martingale with stationary and ergodic differences (M„)„>i 
adapted to {J- n )n>i such that {or almost all x G S 

W [Sn - Mn]2 -> , (5) 

and /or almost all x G 5 

■^L =*> |(x/|iV under . 
yrt 

.Here TV denotes a standard normal variable. 

As a matter of fact we prove the martingale approximation © in the fol- 
lowing equivalent formulation: 

Remark 3 Under conditions of Theorem&there is a martingale with stationary 
and ergodic differences {M n ) n >i adapted to {T n ) n >i such that 

E Q L_n n] ^ q a i mos i sure ly an d i n , (g) 

n 

We point out that condition (|4]) of Theorem [2] does not assure the validity of 
the CLT started at a point for normal Markov chains. Combining the example 
in Derriennic and Lin (2001 a, p. 515) with Cuny (2009 b, Proposition 2.4 and 
the last part of Theorem 2.5, with b(n) 2 — 1/logn) we conclude: 

Proposition 4 Let e £ [0, 1[. There is a stationary and ergodic normal Markov 
chain and a function f such that 

l^-V)<« (7) 



and 

hm sup — ^^^=^^^= = oo a.s. 

n->oo y/ n(loglog n) e 

Everywhere in the paper we denote by 

Vn(f) = (I + Q + - + Q n - 1 )(f) (8) 

and 

H n (x, y) = V n {f){y) - QV n (f){x) . (9) 
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Define the projector operator 

P i (X)=E i (X)-E i _ 1 (X) . (10) 
Then, in terms of V n , and using the Markov property 

Pl(S n ) = V n (&) - QVn(£o) = Hnfafr) . 

Remark 5 It is interesting to notice that by Cuny ( 2009 a, Lemma 2.1) con- 
dition is equivalent to 

^ (log log n) 2 1 \V n (/) 1 1| ^ 

> ^ < oo . 

3 Preparatory results 

3.1 Quenched CLT for stationary and ergodic sequences 

We establish first the central limit theorem started at a point for general additive 
functionals of Markov chains. Since any stationary sequence (Xk)ktEZ can be 
viewed as a function of a Markov process = (Xi]i < k), for the function 
ff(£fc) = Xk the results in this section are valid for any stationary and ergodic 
sequence of random variables. Below and everywhere in the paper a.s. denotes 
either convergence or equality in the almost sure sense. 

Proposition 6 Assume (£ n )nez is a stationary ergodic Markov chain and f €Lq(7t) 
satisfies 

>j=r+ -> a.s. , (11) 

H m (£i,£o) -* H(£i,£o) converges a.s. and E[supiZ"^(£i,£o)] < oo . (12) 

rn 

Then the conclusion of Theorem^ holds. 
Proof. 

Starting from condition (|12p we notice that this implies Hm(Cii Co) — ¥ (£i; £o) 
in L 2 . Since Eo[-ff m (£i, £o)] = a.s. we conclude that Eo[i/(£i, £o)] = a - s - We 
consider the sequence of martingale differences [H (£fc-i, Cfe)]fc>i- Then, we de- 
fine a martingale 



k=l 

adapted to T n and we shall approximate S n by M n . We shall use the decompo- 
sition: 

- ~ M " = -^E„(S„) + -i=[5 n - MSn) - M n ] . 
In order to establish |(SJ), by (fTTj) . it remains to show that 

-E o [S„-E o (S„)-Af n ] 2 ^0a.s. 
n 
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We use now a traditional decomposition of S n in martingale differences by using 
the projections on consecutive sigma algebras: 

S n -E a (S n ) = [S' n -E n _ 1 (S , n )] + [E n _ 1 (S , n )-E„_ 2 (5 n )]+...+ [E 1 (S n )-Eo(5„)] . 
So, by using notation @ we have the martingale decomposition 

1 1 n 

^[S n - E (S n ) - M n ] = -= V^-fc+x - S (&-!,&)] • 
V n v" fe=l 

Then, by the martingale properties followed by the change of variable and using 
the notation 

H m — H = G m , (13) 

it follows that 

1 1 - 

-E [S n -E (S n )-M n } 2 = -£Eo[G n _ fc+ i(&_i,&)] 2 
1 n 

- ^ Eq [Gj (£ n -j ) £n-j+l)] 2 • 



n 



Let AT be fixed. For n sufficiently large we decompose the last sum into a sum 
from 1 to N and one from N + 1 to n. Then, 



^E [S n -E (S n ) -M n f < i^E [G i (e n _ i ,C„_ i+ i)] s 

3=1 

1 - 

- 2 E [G j (Z n - j ,Z n - j+ i)] 2 = I n (N) + II n (N) . 



n 

We shall prove the almost sure negligibility of each term in the last sum. 
We treat first I n (N). Define L 3 {x) := f s G 2 (x,y)Q{x,dy). Then 

Now, by the ergodic theorem for the Markov operator Q, 

— > u a.s. 

n n — j n — j 

for every 1 < j < N, and I n (N) — > a.s.. 

Now we treat II n (N). We bound this term in the following way, 



n 

II n (N)<-^2 sup EolGlfati-i) 



n j=i m>N 
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Notice that 

sup Eo[G£, <E [sup G£,(&-i,&)] 

m>iV m>JV 

Define T(x) := J s sup m> jY G^j(cc, y)Q(x 1 dy). Then, by our assumptions, T € 
-Li(7r), and 

i^" E [su P G^(a-i,a)] = - El i 2 fc ~ lT &)> 

and, by the ergodic theorem for Q, we obtain 




Hence, for every N > 1, 

limsup -Eo[5 n - E (5„) - M„] 2 < E[ sup G*. a.s. 

n^oo ^ m>N 

By (p~2]) and dominated convergence theorem, E[sup m>JV G^ n (£_Q, £1)] — ► as 
TV — ► oo and therefore 

lim -EofSn - E a (S n ) ~ M n f = a.s. and in L : . 

Therefore ([H]) is established. 

To prove the quenched CLT we start from the approximation (O that we 
combine with Theorem 3.1 in Billingsley (1999). It follows that for almost all 
i6S, the limiting distribution of (S n / '\/n) n >i is the same as of (M„/y / n)„>i 
under P x . Then, we shall use the fact that an ergodic martingale with stationary 
differences satisfies the CLT started at a point. For a complete and careful proof 
of this last fact we direct to Derriennic and Lin (2001 a, page 520). 

We easily notice that: 
Remark 7 Condition \12i) holds if and only if there is H(£o,£i) such that 
E[sup(if m -tf) 2 (£ ,£i)] ^0 asN^w. 

n>N 

Notice that actually we proved a stronger result. 
Remark 8 Condition in Proposition [6| can be replaced by 

and 

1 n 

- V sup E [(H m - #) 2 (&,&_i)] -> a.s. 
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Also, by the proof of Proposition [5] we can formulate a limit theorem started 
from a point under centering. 

Remark 9 Condition \12\l in Proposition implies and for almost all x G S 
S n -W(S n ) 



\a f \N under W x . 



where aj = ||JT||§. 



For the sake of applications we give here two corollaries in terms of condi- 
tional expectations of individual summands: 

Corollary 10 Let (£ n )neZ be a stationary ergodic Markov chain and f gLq(7t) 
satisfies condition ill]) and in addition 

^||P_ fe (X )|| 2 <oo . (14) 
fc>i 

Then the conclusion of proposition [6| holds. 

We know from Volny (personal communication) that condition (|14p does not 
imply condition (fTTjl and therefore this last condition cannot be avoided. 

Next corollary provides a sufficient condition easy to verify. We adapt in its 
proof an argument in Peligrad and Utev (2006, proof of Corollary 2). 

Corollary 11 Let (£ n )neZ be a stationary ergodic Markov chain and f gLq(7t) 
satisfies 

V^Mk<oo. (15) 
fc>l v* 

Then the conclusion of proposition holds. 
Proof. By Cauchy-Schwarz, we have 

2 „ + l 

||P-*(*o)||a < J] T'\ l|IP- fc (^o)||l) 1/2 < £ 2"/ 2 ||E_ 2 „(X )|| 2 , 

fc>l n>0 k=2 n n>0 

and condition (TTJ} holds since (||E_„(Xo)||2) is non increasing. Then we notice 
that condition (fT5"|) implies 

x ^ |E (X fe )| 
> j 1 — -r^ 1 < oo a.s. 



/ , ^ 



that further implies (|11[) by Kronecker lemma. 
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3.2 Almost sure results for reversible Markov chains 

In the context of normal Markov chains under condition |T]), the convergence in 
L 2 below is known (Lemma 7.2 in Borodin and Ibragimov, 1994). For reversible 
Markov chains we add here the almost sure convergence. 

Proposition 12 Assume (£ n )™ez is a stationary ergodic reversible Markov chain 
and f sLq(7t) satisfies (U|). We have 

Pi('S'n) = -H«(£o)£i) converges a.s. and in L 2 . 

Denote the limit by i?(£o,£i)- Moreover 

E [lf(£o,£i)]=0 a.s. 

and 

E(sup[If fe - H] 2 (io, £i)) -> as n -> oo . (16) 

It is convenient to simplify the notation when no confusion is possible and 
we further denote H n — H n (£o,£i). The proof will be divided into two lemmas, 
allowing us to reduce the proof of the result for the sequences (H 2n ), (-ffa™) and 
then (H 2 2n). 

The proof follows a classical line, based on the dyadic chaining. We shall 
estimate first, for every positive integers m < n, the expected values E[if n — 
H m ]' 2 ■ Properties of conditional expectation and Markov property give 

E[H n H m f = E[ Yl W)(£i)] 2 - E [ E ^(/)(£o)] 2 - 

m<i<n — 1 m+l<i<n 

Then, spectral calculus shows that (see page 166 in Borodin and Ibragimov, 
1994) 

/l m— 1 

(l-t 2 )[Y / t k fpf(dt). (17) 

1 k=n 

Using (|17p we will be able to obtain maximal inequalities along the subse- 
quences mentioned before. 

Lemma 13 Assume (£ n ) n gz is a stationary ergodic reversible Markov chain 
and f sLq(7t) satisfies ©. Then 

> E max \H2r1 ~ Hod+i] 2 < 00. 

^— ' 2 d <n<2 d + 1 
d>0 

Proof. We shall apply Lemma [TTl from Appendix. By (fTT|) , for every 
2 d < m < n < 2 d+1 - 1, we estimate 

/l n-l 
(l-t 2 )(Y,{t 2k +t 2k+1 )?Pf{dt) 

' k—m 

<{n- to) 2 ^ (1 - t 2 ){\ + t) 2 t 2d+1 p f (dt). 
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Take To = H 2 d+i,Ti = H 2 d+i +2 ■ ■ ■ ^2 d — H 2 d+2. For every < r < d, and 
1 < m < 2 d ~ r , we have 



E[T 2 . m - T 2 . (m _ 1} ] 2 < 2 2r J (1 - t 2 )(l + t) 2 t 2a, ' Pf (dt), 



which yields 



4 max 

2 d <m<n<2< i + 1 - 



<2 2d J' (l-t 2 )(l + t) 2 t 2d+1 p f (dt). 
Now, for every i 6 (—1, 1), we have 

?r -^ 5 = j> - D* 2fc > E 2 E V - Di 2fc > E 22( " 1)i2d+1 ■ 

^ ' k>l d>0 k=2 d d>0 

Then, we obtain (notice that the cases t S { — 1, 1} do not cause any problem) 
VE max [H 2n - H 2d+ i} 2 < f ±±l pf (dt). 



d>0 





Lemma 14 Assume (£ n )nez is a stationary ergodic reversible Markov chain 
and f gLq(7t) satisfies ([4]). Then (i?2™)n>o converges a.s. Moreover, we have 
sup n>0 | #2" | G L 2 . 



Proof. We take W n = H 2 n , and g n {i) = \J\-f 1 ^ t k (which is positive 



fc=2" 



on [—1,1]), and apply Lemma [TH] Hence we only need to prove that condition 
(I2T1) is satisfied, that is 



f\l-t 2 )(j2^gn) E tk ) Pf( dt )< 

^n>l fe=2" ' 



Now, 

2 „+l_ 1 



E(logn) E t k <Cj2 E (loglog(2fc))(t 2fe +t 2fe+1 : 

n>l fc=2" n>lk=2 n - 1 

< C(l + t) £(logl 0g (2 fe ))^ < c£±*> l0g+ 1 bg(1 - ^ 



1 -i 2 

n>l 
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where we used, for the last step a classical result, see e.g. Theorem 5, Ch. XIV. 5 
of Feller (1971). 

Hence, it suffices that 

1 (l + t)(log + |log(l-t 2 )|) 2 

— p f {dt) < oo , 

i i — I 

which is clearly satisfied under our assumption. 

Proof of Proposition 1121 By combining the conclusions of Lemma [T3"l and 
Lemma [T4l we obtain 

E(sup[ir 2fc -ir] 2 (£ ,6))^0 asn^oo . 

To finish the proof, it suffices to show that 

/"] \H n — H n+ i\ 2 e Li. 

n>l 

Notice that H n+1 - H n = Pi(X n+ i), where ¥x{X n+1 ) is defined by (JTUJ) . Since 
the projections are orthogonal 

£EpP 1 (X j+1 )] 2 = ^EpP-j^o)] 2 < E(X 2 ) . 



The following result is known from Derriennic and Lin (2001 b, Theorem 
3.11, ii). Their result is obtained under the condition / G Range{\ — Q) 1 ^ 2 . 
Kipnis and Varadhan (1986), in their discussion on page 4, proved that this 
condition is equivalent to ([3]). 

Lemma 15 Assume (£ n )nez is a stationary ergodic reversible Markov chain 
and f gLq (it) satisfies ((2|) . We have 

— ► almost surely and in L9 . 

Proof of Theorem [2j 

To prove the validity of this theorem we shall apply Proposition [5J By 
Remark [7] combined with Proposition fTS] and Lemma [T5] we have the desired 
result. 
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4 Application to random walks on compact groups 



In this section we shall apply our results to random walks on compact groups. 

Let X be a compact abelian group, A a sigma algebra of Borel subsets of X 
and 7r the normalized Haar measure on X . The group operation is denoted by 
+. Let v be a probability measure on (X,A). The random walk on X defined 
by v is the Markov chain having the transition function 

(x, A) -> Q(x, A) = v{A - x) . 

The corresponding Markov operator denoted by Q is defined by 

(Q/)(z) = / * v{x) = f f(x + y)v{dy) . 
Jx 

The Haar measure is invariant under Q. We shall assume that v is not supported 
by a proper closed subgroup of X, condition that is equivalent to Q being 
ergodic. In this context 

(Q*f)(x) = f*v*(x) = / f{x-y)v{dy), 
Jx 

where v* is the image of measure of v by the map x — > — x. Thus Q is symmetric 
on L,2(7r) if and only if v is symmetric on X, that is v = v* . 

The dual group of X, denoted by X, is discrete. Denote by v the Fourier 
transform of the measure is, that is the function 



g — > v{g) — I g(x)v(dx) with g G X . 
Jx 

A function / sL 2 (7r) has the Fourier expansion 

/ = E f(a)g • 

g ex 

Ergodicity of Q is equivalent to v{g) ^ 1 for any non-identity g € X. By 
arguments in Borodin and Ibragimov (1994, ch. 4, section 9) and also Derriennic 
and Lin (2001 a, Section 8) condition ((4]) takes the form 

Combining these considerations with Theorem [2] we obtain the following 
result: 

Corollary 16 Let v be ergodic and symmetric on X . If for f mL^vr) condition 
\18\) is satisfied then the central limit theorem holds for the function f and for 
the random walk generated by v, started at x € X for n— almost every x € X. 
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A simple example is given by the following random walk on the one dimen- 
sional torus which was considered in Paroux (1993) and Derriennic and Lin 
(2001 a and 2007). 

On X =K/Z we take v = 8 a /2 + 5_ a /2 with a £ [0, 1] irrational. The 
random walk defined by v, started at x, performs on the orbit of x under 
the ergodic transformation T : x — > x + a (mod 1), a simple random walk 
with the probability of a step equal to 1/2. The Fourier coefficients of v are 
v(n) = [e^na +e -2m n ay 2 . For this example Derriennic and Lin (2001) showed 
that |1 — i>(n)\ ~ C{na} 2 , when the fractional part of na, denoted{na}, tends 
to 0. With f(n) denoting the n t?l -Fourier coefficient of the function / we have 
the following result: If 



E 



|/(n)| 2 (log + |log{ na} 2 |) 2 

< oo 



\na} 2 
o^nez 1 ' 

condition (fT8| is fulfilled and then, the CLT holds for the function / and the 
random walk generated by v started at x, for almost every x G R/Z. 

If on X =K/Z we take v = S a /4 + <5_ a /4 + <5o/2, computations in Derriennic 
and Lin (2001 a) show that condition (jT5J) is satisfied as soon as 



|/(n)| 2 (log + |log(sin 2 (n 7 ra)|) 2 
o^z sin 2 (n™) 



< oo 



Therefore, under this condition, the CLT holds for the function / and the ran- 
dom walk generated by v, started at for almost every x € K/Z. 



5 Appendix 

The maximal inequality in this lemma is obtained by a chaining argument. It 
is quoted from Wu (2007). 

Lemma 17 Let p > 1 and (T'n)o<n<2 d ^ e random variables in L2. Denote 
T* := maxi<fc<„ \T^ — Tq\, 1 < n < 2^. Then we have, 

\\T* d h < EE E ( T2 "" " T 2^i)) 2 ] 1/2 - (19) 

r— m— 1 

Next lemma provides a useful analytic tool to estimate maximum of partial 
sums when the variance of partial sums is estimated as an integral. It is designed 
to be applied directly in our proofs but the idea of proof should be useful in a 
more general context. It is motivated by the paper Moricz, Serfling and Stout 
(1982). 
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Lemma 18 Let (W n ) n >i be a sequence of square-integrable variables, and (g n ) 
a sequence of positive B or el functions on [—1,1]. Assume that there exists a 
positive finite measure /i on [—1,1], such that 

E[W n - W m } 2 < f [g m+ i(t) + ...+ g n (t)] 2 fi(dt) for every 1 < m < n. (20) 



l 



If 



/ 1 [^(logn)g„(t)] 2 / i(^)<^ , (21) 
J—i ^.i 

n>l 

then (W n ) n >i converges almost surely and sup n>1 \ W n \ G L2. 
Proof. 

Let d be a positive integer. We shall apply Lemma Q~7] with T = W 2 d , T\ — 
W 2 d +1 , . . . ,T 2 d — W 2 d+i. Notice that, by using (|20p. and the positivity of the 
functions gi we have 

2 d-r 2 d-r 

E E[T 2 . m - T 2 . (m _ 1} ] 2 < / E [-92 , '(m-l)+2 ti + l (*)••• + 92 r m-\-2 d 
m=l *' _1 m=l 

,1 2'"" 



< / [ E 9k(t)] 2 Kdt) 

J ~ 1 k=2 d + l 



Hence, we obtain 

1 2 d+1 

max [!y fc -WV] 2 <]T(d+l) 2 / [Y] <7fc(*)]V(^). (22) 
On the other hand, by Cauchy-Schwarz 

E i W2d+i - ^ E TfcTi^ E( d+ !) 2 i^ +1 - ^i 2 , 

d>0 fe>0 ^ ' d>0 

and, by using (|20|) . 



1 2 d+1 

E[El^ +1 -^|] 2 <yE( d+1 ) 2 / [E 9k(t)]M*t)- (23) 

d>0 d>0 fe=2 d + l 

By the positivity of the functions gi, we see that condition (f2"T]) implies the 
convergence of the right hand side of (|22[) and (|23|) . 

Hence (W2») converges a.s. and max 2 d +1<k<2 d+i \Wk — W 2 d \ goes to a.s., 
which yields the a.s. convergence of (W n ). Moreover, for 2 d < n < 2 d+1 , 

\W n \<\W 2 d\+ max \W k -W 2 d\) 

2 d + l<k<2 d + 1 

d-1 

< IWil + V \W 2k +i -W 2 k\+ max iWfc - W 2 d\, 

^— ' 2 d + l<k<2 d + 1 

k=0 - - 
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and 



supV^ 2 <3 [W? + (J2\W, 



2 k+i — 




\w k -w 2d \ 2 ) eii, 
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